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Abstract 



In this paper we show that the continuum time version of the Minority Game 
satisfies the criteria for the application of a theorem on the existence of an invariant 
measure. We consider the special case of a game with "sufficiently" asymmetric initial 
condition where the number of possible choices for each individual is S = 2 and 
r < +oo. An upper bound for the asymptotic behavior, as the number of agents grows 
to infinity, of the waiting time for reaching the stationary state is then obtained. 

1 Introduction 

The Minority Game (MG) [6j is a simple model based on Arthur's "El Farol" bar problem 
PQ which describes the behavior of a group of competing heterogeneous agents subject to 
the economic law of supply and demand. An application of the MG is, for example, the 
microscopic modeling of financial markets [21 El HJ [10] . 

In this paper the attention is focused on the continuum time version of the MG (see 
perhaps [7]), where the number of possible choices for each individual is S = 2. In 
particular we are interested in studying its long time behavior, in terms of existence of an 
invariant measure for its dynamical variables and convergence of the dynamical variables 
distribution to it. 

Let us fix some notations, coherent with those used in |11| . Consider the MG with 
N agents. Its dynamics is defined in terms of dynamical variables U S j(t) in discrete 
time t = 0,1,...; these are scores corresponding to each of the possible agents choices 
s = +1,-1. Each agent takes a decision Sj(i) with 



where Tj > 0. The original MG corresponds to Tj = oo and was generalized to Tj = T < oo 
[5]; here we consider the latter case. 

The public information variable fi(t) is given to all agents; it belongs to the set of 
integers {1, . . . ,P} and can either be the binary encoding of last M winning choices or 
drawn at random from a uniform distribution; here we consider the latter case. 

The action ^ X i of each agent depends on its choice Sj(t) and on fi(t). The coefficients 
o^j, called strategies, are uniform random variables taking values ±1 {Prob{a t ^ i = ±1} = 



Prob{si(t) = s} 



e TiU s ,i{t) 
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Let us introduce the following random variables (to ease the notation the choices +1 
and —1 are shorted with + and — ) 

9 ' 9 



2 

i=l 



and their averages 



p p 



The only relevant quantity in the dynamics is the difference between the scores of the two 
strategies: 

»(*) = r g ' 

where r = |r. 

Let (fij^P) be the probability space respect to which all our random variables are 
defined, y = {yi)i<i<N, © = (© A ')i< M <P and £ = (&)i<i<jy 

As shown in [11], if P/N = a S K+, S = 2 and Tj = T > for all i, the dynamics of 
the continuum time limit of the MG is given by the following iV-dimensional stochastic 
differential equation 

dVi(t)= ^-^e-^l^tanh^oj dt + A i (y,N,T,OdW(t), i = l,...,N (1) 

where 

W(t) is an ^-dimensional Wiener process, 

Ai is the i-th row of the N x N matrix A = (Ay) such that 

Ta% r (y) 

(AA%(y,N,T,0= ^ Ur 

If a > a c , where a c = 0.3374 . . . marks the transition point from a symmetric (a < a c ) 
to an asymmetric phase (a > a c ) characterized, respectively, by no predictability and 
predictability (in the asymmetric phase the choices +1 and —1 do not appear with equal 
probabilities for a given //(i)), then the function cr%^ '■ ^ N — > K + is continuous and 

,. a N,Ay) ^ n 

lim sup — — < 1, 



(see [am]). 

In [TT] the authors derive the full stationary distribution of y. Here, by proving that 
equation ([1]) satisfies the criteria for the application of Veretennikov's Theorem (see [13] ) , 
we show for the continuum time version of the MG with S = 2, "sufficiently" asymmetric 
initial condition, T < +oo and a > a c , that, for N sufficiently large, the distribution 
is(t) of y converges almost surely with polynomial rate to an invariant measure v^ nv and 
that the waiting time for reaching the stationary state is at most O(|y(0)| 2 ). For finite 
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asymmetric initial condition this means that the waiting time is at most O(N) or, since 
£=a>0,O(f). 

The work is organized as follows. In section [2] some preliminary computations useful to 
characterize the asymptotic behavior of the drift coefficient of equation ([1]) are performed. 
In section [3] Veretennikov's Theorem is applied to equation ([T]) with both finite and maxi- 
mally (|y(0)| — > oo) asymmetric initial condition and an upper bound for limiting behavior 
as N grows to infinity of the waiting time for reaching the stationary state is obtained. 
In section H] some conclusions are drawn, while Appendix contains the Veretennikov's 
Theorem. 



2 Preliminaries 



Let us start by proving some preliminary results showing that, despite the fact that the 
coefficients present in the drift term of equation (pQ) are random variables assuming both 
negative and positive values, as N grows to infinity the behavior of equation (pQ) becomes 
dissipative and hence suitable to the application of a stability theorem, like the Vereten- 
nikov's one. For the sake of simplicity in notation, let us assume P = N, i.e. a = 1. The 
results obtained still hold for any a > 0. From now on, when defining a probability event 
we shall omit to explicit the dependence of the random variables on the ws £ 11. 



Lemma 2.1 For every i = 1,2,... 

lim Ci@ = A lim & 



N^oo 



lim £f = a 

N^oo 1 



N 

a A lim Yj &0=° 



where a is any constant. 
Proof 

Obviously, for every i 



N 



lim &0 = A lim £ 2 = a A lim V = > < 

P <J lim if = a \ . 

It remains hence to show that also the inverse inequality holds. 
For every i, 

N 

lim &0 = A lim £ 2 = a A lim y = 



lim 

N—>oo 



1 N 

N S 



/x=l 



«,i) 2 - «,) 2 



A lim £ 2 = a 

JV-»oo 4 



N N ] 

A lim V -V«f=0 



(2) 
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Since {£f L is a family of independent (on both and i) random variables identically 
distributed over the set {—1, 0, 1} and since (a+ J 2 — (a^_ J 2 = 0, the right hand side term 
of (|2|) is greater than or equal to 



hm — 



N N a^ + at 



- - 1 " 1 

^ = 0A lim & = aN lim > — V^ = 0> 



lim = a 

AT-»oo 1 



1 ^ ^ fl J,.|/ 



lim ±y y^L 



AT AT 

OAlim V i- W = (A 

N^oo ^ N ^ 3 • 



Let 77j = X^Li £f an d = J2^=i + '°2 ~' J an d Cj both depend on N, but since for ev- 
ery N, K[r]j] = E[Cj] = we omit to explicitly write the N dependence); |r?j + Q = Y^,=i a +j\. 

is a family of independent identically distributed random variables with mean E[r/j + Q] = 
0. 

Since by the Law of Large Numbers (LLN) 

f 1 £ 1 f 1 N 1 

P< lim — > (77,- + d) = > = 1 P< lim — > m = > = 1, 



it follows that 



and the thesis follows. 



f 1 " 1 

lim — V 6 = > = 1 



□ 



Lemma 2.2 For every i = 1, 2, 



Proof 



Since E[(£^) 2 ] = |, it is a consequence of the LLN. 



Lemma 2.3 For every i = 1,2,... 



□ 



f _ ! v 1 

lim &e = A lim & = - A lim V 66' = > = 1. 



Proof 



It is an immediate consequence of Lemma 12.11 and Lemma [2? 



□ 
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Lemma 2.4 Let 



D; 



lim £? = - 

N->oc 1 2 ' x AT->oo 
J j/* 



1,2,... 



Then 



n * = l 



. i=1.2, 



Proof 

For every i = 1,2, 



> 



N^oo 



lim 

N^oo 



1 1*1 

- A lim iW = 

2 / \ N->oo N £-^ 3 | 
j=l,2,...,j^i n=l ) 

e = -X rr pj lim - r ye = 

J j 1.2 ./ .-/ ^ M=l 



> = 1, (3) 



where last equality is due to Lemma 12.21 and the LLN. 
Let 

D X = B U D i = B i nB i _ 1 , a = 2,3,... 
Obviously P (A) = P (A) = 1. Under the inductive hypothesis P (A-i} 

p (A) = p (A-i n Si) = P (flilA-i) f (A-i) = i. 



1; by © 



Since {A}jgN is a decreasing sequence 



n «. 

,i=l,2,... 



Let us define the following events: 



Pi A = lim P(A) = 1. 

' 1 I i — *r>n 



>i=l,2„ 



□ 



j4i = ^ lim lim — 

AT— >+00 £1— >±0O N 



Ai = < lim lim — 

AT->+oo |a;|^oo N 

i = 2,3... 



v 



i\Qx\ + £| tanh(xi)xi + tanh(xj)zi 

AT 

iiQxi + £? tanh(xj)xj + ^ tanh(xj)xj 



1 

2 f ' 



and 

Si = Ai, ^ = ^0^-1, i = 2,3,... 
Lemma 2.5 For every i = 1,2,..., 

P(^) = l. 
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Proof 



Since 

tanh(xi)xi tanh(xi)xi 

lim Jim — = 1 and lim — — - — = ±1 

iV^+ooXi^±oo N a5i-*±oo,Xj-»±oo t&mx{Xj)xi 

by Lemma[231 P (Ax) = 1. About to the A i: i=2,3,. . . , if Xi -> ±oo, obviously P (Aj) = 1. 
If x, ^ ±oo, since tanh is a bounded odd function, by Lemma |2~%1 ^ 0*4*) = 1- 

□ 

Lemma 2.6 For every i = 1,2,..., 

P(£i) = l. 

Proof 

The proof is the same of Lemma 12.41 with E% and Ai instead of Di and Bi . 

□ 



3 Convergence to the Invariant Measure 

In this section we show that, for N sufficiently large, the distribution of the random 
variable y, the score differences vector whose dynamics is described by the stochastic 
differential equation (pQ), admits an invariant measure and we study the limiting behavior 
of the waiting time for reaching the stationary state. 

For this purpose we perform an opportune rescaling of the variable y and show that the 
dynamics of the rescaled variable z satisfies the criteria for the application of Veretennikov's 
Theorem (Theorem 15. II in Appendix or see [13]). As a second step we extend the thesis of 
Veretennikov's Theorem to the original random variable y. 

The Veretennikov's Theorem gives, under quite general regularity assumptions, a con- 
dition that suffices the existence of an invariant measure and the convergence to it for the 
distribution of a random variable satisfying a stochastic differential equation. The criteria 
for the application of such a theorem to a stochastic differential equation are based on the 
evaluation of the drift term on the initial condition that must be such that \y(0)\ ^ 0; this 
means that we must avoid a game where all the agents have symmetric initial condition 
(i.e. y(0) = 0). We focus our attention on two cases: a game where there exists at least 
one agent having maximally asymmetric initial condition (|?/j(0)| — ► oo) and no matter 
about the other agents (they can or not have symmetric initial condition) and a game 
where \y(0)\ < oo and the number of agents with asymmetric initial condition (j/i(0) ^ 0) 
is O(N). The former situation corresponds to a game where there is at least one agent 
playing always the same strategy since the beginning (a so called producer), while the 
latter one corresponds to a game where the number of agents perceiving a strategy more 
successful that the other one since the begging is O(N). 

Let b?(t,&,x) : ({-1, 0, l} PxN , R p , R N ) -> R defined as 

N 

6f(e,6,x) = £e + ^^tanh(x,), 
i = 1,2,... ,N 
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and 

^((,6,^ = ^(^0,1))^. 
Equation ([I]) can be written in the form 

dy(t) = -b N (£, 9, y)dt + A(y, N, T, £)dW(t). (4) 

b (£, G, y) is obviously a Borel-measurable locally bounded function. 

Let c be a bounded constant (that may depend on N) greater than 1 and z = cy; 
under this rescaling of the variable y equation @ becomes 

dz(t) = -cb N 6, dt + cA (^,N, T, f ) dW(t). (5) 

Before going to study the limiting behavior of equation ([5]) as iV grows to infinity, let us 
prove the nondegeneracy of the the diffusion matrix A, a condition for the application of 
Veretennikov's Theorem. 

Proposition 3.1 There exists N > such that for every N > N the diffusion matrix A 
is almost surely nondegenerate. 

Proof 



Nondegenerancy is equivalent to the following condition 



infinf inf xAA'(y, N, T, £)x' > 
y £ 1x1=1 



where T is fixed and x € 



DiV 



Since cr^ r > it is sufficient to show that 



lim 



66 e 2 



\ 6v6 6v6 



66v \ 

66v 



e N j 



al 



where a is a positive constant and I is the identity matrix. 

This follows from Lemma 12,41 and hence we obtain the thesis. 



□ 



3.1 Minority Game with maximally asymmetric initial condition 

We consider a game where there exists at least one producer, that is an agent i such that 
1 7/i (0)| — > oo. We show that, under an appropriate choice of the constant c, system ([5]) 
satisfies the criteria for the application of Veretennikov's Theorem and then we extend the 
results of Theorem 15. II to the original system (jl]). To ease the notation let y(0) = x. 



Proposition 3.2 



Proof 



lim lim — - ' ' — — — - > - )> — 1 . 

N— >oo \x\^oo N 
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Iim lim - > — 

AT-+0O [x|-++oo N 2 



1 



N 



lim lim — 

N^+oo \x\->+oo N f-* 

OO j 

Elim lim — 
N^+oo \x\->+oo N 



N 



iiQxi + tanh(xj)xj +^ tanh(a 



i=i 



A' 



^Gxj + Q tanh(xj)xj +^ tanh(a 



n ^ = p n ^ 



.i=l,2,... / \i=l,2,... 

Since {£ , j} igN is a decreasing sequence, 



> 



P fl Ej = lim T(Ei 



,i=l,2, 

By applying Lemma 12.61 the thesis follows. 
Corollary 3.1 There exist N > and Mq > suc/i i/tai for every N > N 



□ 



& JV (£,e,*),^\>(^-iji^ N > Mo a . s . 



Proof 



It is an immediate consequence of Proposition 13.2 



□ 



Proposition 3.3 Equation f5|) with c > 1 + N 2 satisfies a.s. condition \12§ with 



c(f-l)>f + 1. 



Proof 



It is an immediate consequence of Corollary 13.11 and Proposition 13.11 



□ 



In Proposition 13.41 Veretennikov's Theorem is applied to equation ([5]), while the exis- 
tence of an invariant measure for y and the rate of convergence to it is derived in Corollary 



Proposition 3.4 Let v(t) be the distribution of z(t) = (£i(i))i<i<jv satisfying equation 
(0j with initial condition z(Q) and c > 1 + N 2 . For N sufficiently large, there exists a.s. 
an invariant measure Vi nv for z such that 

Ht) - v im} \ < m(l + |z(0)f)(l + t)- (W) , 

where m is a positive constant, < k < c — l) — y — 1, 2k + 2 < I < 2c — l) — N 
and |z/(t) 

^inv\ is the total variation distance between v(t) and v%nvj i.e. \v(t} Vinv\ '■ — 
sup AeB \v(t)(A) - u inv {A)\. 
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Proof 



It is a consequence of Proposition 13.31 and Theorem 15.11 



□ 



Corollary 3.2 Let v'{t) be the distribution of y(t) = (yj(t))i<j<Ar satisfying equation ^ 
with initial condition y(0) and let c = 1 + N 2 ^ + 



T- (f-1) 

exists a.s. an invariant measure v'- for y such that 



\v'(t)-vl nv \ <m'(l + \cy(0)\ l )(l + t)-( k+1 \ 
where m! is a positive constant, < k < N 2 and 2k + 2<l<2 + — - 

Proof 



^ . For N sufficiently large, there 

(6) 



Since the limit as N grows to infinity of c is 1 and z = cy, for N sufficiently large 
\u'(t) — v' inv \ = m'\v{t) — Vi nv \ and the thesis follows from Proposition 13.41 

□ 



3.2 Minority Game with finite asymmetric initial condition 

Now we move to a game where |y(0)| < oo and the number of agents with asymmetric 
initial condition (y;(0) ^ 0) is O(N). 

Let y(0) = x and N 1 = ff {yi : yi(0) ^ 0} and suppose that N' = 0(N), i.e. limAr^oo ^j- 
7, < 7 < 1; moreover let /3j = tanh(xi)xj and (3 = min{/?j : fa ^ 0}. To ease the notation, 
let us suppose that x\ is such that f3 = tanh(xi)xi. 



Proposition 3.5 



\ (b N (£,e,x),x) 1 
P { lim ^ ^' - ; 1 > - fry 



Proof 



• (gfcMj > i ' 

W-oo N ~ 2 H ' 



A"->oo N' ^ 



N' 



i=l 



AT' 



iiQxi + £ 2 iwh(xi)xi iiij tanh(. 

_ AT' 

iiQxi + £f tanh(xi)xi tanh(x.,)xi 



P < lim 



where last equality is a consequence of Lemma 12.3 



□ 



Corollary 3.3 There exist N > and Mq > swc/i iaaf /or ewer?/ N > N 



^(£,e,x),|^\>/3 7 (f "l)o W > M a.s. 
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Proof 

It is an immediate consequence of Proposition 13.51 



□ 



Proposition 3.6 If < (3j < 1, then equation with c > ^1 + n 2 satisfies a.s. 
condition HE) with r = c (f - l) > f + 1. 

Proof 

It is an immediate consequence of Corollary 13.31 and Proposition 13.11 

□ 

In Proposition 13.71 Veretennikov's Theorem is applied to equation ([5]), while the exis- 
tence of an invariant measure for y and the rate of convergence to it is derived in Corollary 
EX 



Proposition 3.7 Let v{t) be the distribution of z(t) = (-Zj(i))i<i<Ar satisfying equation 
(0j with initial condition z(0) and c > ^1 + n 2 with < /?7 < 1. For N sufficiently 
large, there exists a.s. an invariant measure Vi nv for z such that 

Ht) - u inv \ < m(l + |*(0)|')(1 + 

where m is a positive constant, < k < c — l) — ^ — 1 and 2k+2 < I < 2c — l) —N. 

Proof 

It is a consequence of Proposition 13.61 and Theorem 15.11 

□ 

Corollary 3.4 Let v'{t) be the distribution of y(t) = (yj(t))i<j<jv satisfying equation ^ 
with initial condition y(0) and let c = 4- I 1 + N 2 + 2 $ I with < f3j < 1. For N 
sufficiently large, there exists a.s. an invariant measure v' inv for y such that 

W{t) - v' mv \ < m'(l + MOJI'XI + ty( k+1 \ (7) 



where m! is a positive constant, < k < + l) ~ 1J + ^ at 2 1 anc ^ 2A; + 2 < / < 

iV (^" 1 ) + ^ + ^^T- 
Proof 

Since the limit as iV grows to infinity of c is -g- and z = cy, for iV sufficiently large 
\v'(t) — v' inv \ = m'\v{t) — Vi nv \ and the thesis follows from Proposition 13.71 

□ 
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3.3 Waiting time for reaching the stationary state 

Corollaries 13.21 and 13.41 provide a rate of convergence toward the invariant distribution for 
the score differences distribution; by making explicit t from © and ([7]), it is hence possible 
to obtain the limiting behavior as N grows to infinity of the waiting time for reaching the 
stationary state. Being the criteria for the application of Veretennikov Theorem sufficient 
conditions for the existence of an invariant measure, the waiting time obtained may not 
be the smallest one, and hence we have to talk of upper bound of the waiting time for 
reaching the stationary state. 

Since the scores time is the y's time rescaled by T, i.e. yi(t) = Y U+ '^ t ^ T ~ > 2 U ~ , '^ t ^ r ^ , 
in studying the waiting time for reaching a stationary state for the MG we have to refer 
to the time r = 4, that is the own time of the scores U S) i corresponding to each agents 
possible choices s = +1, —1. 

In Proposition 13.81 the asymptotic behavior of the waiting time for reaching the sta- 
tionary state both for a MG with maximally and finite asymmetric initial condition is 
obtained. 

Proposition 3.8 For every e > let T be such that 

m'(i + |q/(o)| z )(i + rr)-( fc+1 ) = e, 

where I and k are as in Corollaries \3.S\ and \ 3.4\ (for games with maximally and finite 
asymmetric initial condition respectively) . 
It follows that 

V(TT)-v' mv \<e 

and 

i) if |2/(0)| -> oo 

T m' 

hm - — . , ,„ = — — , (8) 
iv^oo |y(0)| 2 eT' y ' 

ii) i/liniTv^oc ^ = 7; where < 7 < 1, N' = # {yi : j/j(0) ^ 0} and \y(0)\ < co, 

er - JV^oo |y(0)| 2 ~ N^oo eT 1 yy n ' K ' 

Hi) under same conditions of point ii) with (3^ = 1 



7V->oo|y(0)| 2 er' 
where m' and m" are positive constants. 
Proof 

i) By Corollary 13.21 for N sufficiently large, 

t _ (^(i + NQ)|'))^-i 



T m" 

hm — — = — , (10) 
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where m is a positive constant, < k < -^ — - and 2k + 2 < I < 2 + — -. 
In the limit N — > 00 we obtain c = 1, = and 1 = 2; it follows that 



T m' 

lim 1 — . , = — — . (11) 

tv^oo |y(0)| 2 er v ' 



ii) By Corollary 



AM 



2,2 2 



< T < 



r r 

and (|9|) follows. 

m; Since < k < (f + l) - l) + and 2A; + 2 < I < N - l) + £ + 

j- a; 2 , in the limit JV^oowe obtain c = 1, & = 0, / = 2 and ()10p follows from ([9]). 

— 1 



■in 



□ 

Since, if the initial condition is finite, |y(0)| 2 = O(N) and since = a > 0, from point 
'J of Proposition 13,81 it follows that T = O(^). 



4 Conclusions 

By applying the Veretennikov's Theorem to the continuum time version of the MG, we 
have obtained an upper bound for the asymptotic behavior, as the number of agents grows 
to infinity, of the waiting time for reaching the stationary state in the asymmetric phase 
(a > a c ). 

Since Veretennikov's Theorem gives a sufficient condition for the existence of an in- 
variant measure and it applies only to stochastic differential equations with not null initial 
condition, the waiting time obtained may not be the smallest one (it is an upper bound) 
and it holds only for a MG with asymmetric initial condition. The fewer are the agents with 
initial asymmetry in evaluating their strategies, the stronger must be their asymmetry: 
if their number is o(N), then at least one agent must have maximally initial asymmetry 
(|yi(0)| = 00), while if their number is O(N) the initial asymmetry must be inversely 
proportional to their fraction with respect to the agents population size (/?7 = 1). It 
follows that the single-agent's weakest initial asymmetry allowed by our result is cc, such 
that Xjtanh(xj) = 1 (xj ~ 1-2), corresponding to a game where all the agents (7 = 1) 
have asymmetric initial condition. Our result is simply not applicable to a game with 
initial asymmetry weaker than the previous one. It is worth to note that the limit we 
have derived agrees with the rule of thumb in performing numerical simulations to wait a 
number of time steps proportional to in order to reach the stationary state and that, 
being T = O(^p), the time to equilibrium increases as a > a c goes toward a c . 



5 Appendix 

Consider the ra-dimensional stochastic differential equation 

dX(t) = b{X{t))dt + a(X(t))dW(t) 
X(0) = i£f, 
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either with initial data X(0) = x € W 1 . 

W(t) is an m-dimensional Wiener process with m > n, b is a locally bounded Borel 
function from M n with values on M. n and a a bounded continuous non-degenerate matrix 
n x m-function and suppose that the drift term satisfies the following condition: there 
exist constants Mq > and r > such that 



where \fi x (t) — /iinvl *s the total variation distance between fi x (t) and /ii nv , c is a positive 
constant, (J, x (t) is the distribution of Xt, x being the initial data, and /i; nv is the invariant 
measure for X t ; in particular fj,{ nv does exists. 
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